A GEOMETRIC REALIZATION OF DEGENERATE PRINCIPAL 
SERIES REPRESENTATIONS OF 
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Abstract. The multidimensional quantization procedure, proposed by the first 
author and its modifications (reduction to radicals and lifting on [/(l)-coverings) 
give us a almost universal theoretical tools to find irreducible representations of 
Lie groups. By using this method and the root theory, we realize in this paper the 
representations of the degenerate principal series of symplectic groups. 



1. Introduction 

Let us consider a Lie group G and its Lie algebra q. The group G acts on its Lie 
algebra g by adjoint representation Ad and in the dual vector space g* by coadjoint 
action K : = coAd. The vector space q* is therefore divided into the disjoint union 
of coadjoint orbits (or if-orbits). Each coadjoint orbit E Q* /G admits a nat- 
ural C7-homogeneous symplectic structure, corresponding to the Kirillov form Bq 
associated with the bilinear form 

B F (X,Y) := (F,[X,Y\), 

where F 6 q*, the kernel ker B F of which is just isomorphic to the Lie algebra 
qf := Lie Gf of the stabilizer Gf of a fixed point F E £1. Therefore, the triple 
(Q, Bq, G) is a homogeneous symplectic manifold (Hamiltonian system) with a flat 
action, i.e. 

{fx,fY) = f\xy\,VX,Y eg, 
where fx is such a function that dfx = —i{£,x)Bsi and 

£ x (m) := ^|i =0 exp(tX)m, 

see [jl]] of G. Following the well known classification theorem of A. Kirillov-B. 
Kostant-Souriaux, every homogeneous symplectic manifold with a flat action of G 
is locally diffeomorphic to a coadjoint orbit of G or its central extension G by K. 
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This means that all the Hamiltonian systems with a flat action of G are locally clas- 
sified by the coadjoint orbits of G or its central extension G by R. The Hamilton- 
ian systems can be quantized to become quantum systems with unitary symmetry 
representations of) G. In order to do this, one uses affine connection V with the 
symplectic curvature 

^ /» »\ 27ri 

Curv(V) = —uj 

I i 

on the homogeneous symplectic manifold (M, u, G) with a flat action of G to pro- 
duce a quantization procedure 

Q . c°°(fi) -> £(H), 
where £j is the symplectic gradient of f £ C°°(Q), i.e. 

and H is a separable Hilbert space. This correspondence is a geometric quantization 
procedure because it satisfies the following relations 

27T? 

Q({f,g}) = —[Q(f),Q(g)], 

Q(l) =Id H . 

It means that this correspondence defines a homomorphism 

A : C°°(fi) ->£(H), 

27T? 

/-A(/) :=— W), 

i.e. a representation of the Lie algebra of smooth functions with respect to the 
Poisson brackets in the Hilbert space H. 

An element X £ g can be considered as a function on $j* and therefore the 
restriction X |n belongs to C 00 (fi) and we can obtain the corresponding Hamiltonian 
field Xq from the condition 

t(X n )B n = dX\ n . 

The condition asserting that the action is flat means that the correspondence 

X £ g h-> X\ n £ 

is the Lie algebra homomorphism and we have a representation of Lie algebra g 

2iri 

legn A(X) := — Q(X\ n ) 
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by auto-adjoint operators in the Hilbert space H, which is as usually constructed as 
the completion of some subspace of so called partially invariant partially holomor- 
phic sections of the quantum bundle, associated with some fixed polarization. This 
is what we means the multidimensional quantization procedure. 

One considers also the reductions of this multidimensional quantization proce- 
dure in the following sense. Let us denote the (solvable) radical of Gp by Rp and 
the unipotent radical by u Rp. 

In the above construction, there appeared some so called Mackey obstruction. In 
order to kill this Mackey obstruction, we supposed some additional conditions on 
the action of stabilizers Gf on the dual object of inducing subgroups H is triv- 
ial, see [JT]]. Duflo [|]] proposed another method of Killing this Mackey obstruction 
by lifting to the Z/(2) coverings of the stabilizers. One has a lifting of any ho- 
momorphism of Gf into the symplectic groups of the orbit at the fixed point F 
onto a homomorphism of Z/(2) covering G F of Gf into the metaplectic group 
Mp(Tpfi), following the commutative diagram 

1 ► Z/(2) ► G F /{2) ► G F ► 1 



1 ► Z/(2) ► Mp(Tpfi) > Sp(T F 0) > 1 

Replacing the metaplectic groups Mp by the (complex) metaplectic Mp c groups, 
Tran Vui [§] and Tran Dao Dong 0] considered the same lifting toU(i) coverings 
of the the stabilizers. One has to lift each homomorphism of Gp into the symplectic 
groups of the orbit at the fixed point F onto a homomorphism of U(l) covering 

G 1 ^ of G F into the metaplectic group Mp c (Tpfi), following the commutative di- 
agram 

1 ► U(l) > G F {1) > G F > 1 



1 * U(l) > Mp c (T F Q) > Sp(Tpfi) ► 1 

It was shown that these modifications give us some privileges for constructing 
irreducible unitary representations. The theory was settled in the general context, 
but still it is difficult to realize in concrete situations. The discrete series representa- 
tions of semi-simple Lie groups are realized by these constructions as globalization 
of Harish-Chandra modules, see [|7fl, |]l0[l . 

The degenerate principal series representations of semisimple Lie groups were 
constructed and studied in many works, beginning from Harish-Chandra, updated 
by Vogan and others see e.g. Vogan for the general semisimple Lie groups, Lee 
[§] for symplectic groups, etc. The theories however were purely analytic. It is 
natural to try to use the developed geometric quantization method to describe these 
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representation. In this paper, the general theory of geometric quantization is applied 
in the situation of symplectic groups and we describe the computation results. 

2. Structure of Coadjoint Orbits 

Let G = Sp 2n (lR) be the symplectic group, g := Lie G its Lie algebra and g* = 
Hom K (g,M) the vector space dual to the Lie algebra g. We study in detail the 
coadjoint orbits of the symplectic group. 

Lemma 2.1. The Lie algebra g, its dual vector space g* are realized by matrices 
and the coadjoint action ofG in g* is just the conjugation 

K = coAd : G x g* -> g*, 

(g,F)^K(g)F = gFg- 1 . 

Proof. Recall that the adjoint action of G on g can be realized as conjugation 

Ad : G x g -> g, 

(2.1) (g,X)^Ad(g)X = gXg- 1 . 

Let us denote the trace of a matrix by tr. To each matrix Y G g we define the 
associate functional F Y G g* by 

(2.2) (F Y ,X)= tr(YX), VX G g. 

Then the map g — >• g*, Y i— > Fy is an isomorphism from g onto g*. We identify 



therefore F G g* with a matrix denote by the same letter F and ^2] become 
(2.3) (F,X)=tr(F.X) 
Recall that 

(K(g)F,X) = (F,Ad(g- 1 )X) 



and using |2J] and [O] we have 

(K(g)F,X) = (i^AdGr 1 )*) 

= (F, g~ l Xg) 

= tr(F.g- l Xg) 

= trigFg-'X) 

= (gFg-\X,), 

for all g G G, x G g and F G g*. 
We have therefore, 

K(g)F = gFg- 1 ,WgeG,WFeg*. 



□ 
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Remark 2.2. We fix a special element F £ q* presented by a matrix of type 



F = 



-Ai 
Ai 



\ 



-A f 

X r 







V 



... 



/ 



where A, G K, Aj > 0, Aj 7^ A-,, i, j = 1, . . . , n. Consider the coadjoint orbit Vl F 
passing through this point F, 

Q F = {K(g)F I geG}. 

Proposition 2.3. The stabilizer G F ofF consists of the matrices of type 

fan \ 

922 



9r 



fiV+l,r+l / 



where 



9i 



cos Ai sin Ai 
sin Ai cos Ai 



i= l,...r, g r +i,r+i e Sp 2 ( n _ r )(M). 

Proof We can write each element of Sp 2n (R) into block format 

/ 011 912 ••• 9lr 9l,r+l \ 

_ 921 922 ■ ■ ■ 92r 92,r+l 

\9r+l,l 9r+l,2 ■■■ g r +l,r 9r+l,r+l ) 

where is a 2 x 2 matrix, for i, j = 1, ...,r, g^ r+ i is a 2 x 2(n — r) matrix, 
for % = l,...,r, g r+ ij is a 2(n — r) x 2 matrix, for j = l,...,r, g r+ i tT+ i is a 
2(n — r) x 2(n — r) matrix. We write F in the same format form 

/ Fu F\2 ■ ■ ■ Fi r F\,r+l \ 

F2I F22 ■ ■ ■ F2 r F2r+1 



\F r +l,l Fr+1,2 ■ ■ ■ Fr+l,r -^r+l,r+l / 



where = is 2 x 2 matrix, for i, j = 1, . . . , r, % 7^ j, Fa = 



-A, 
Ai 



1, . . . , r, F i>r+ i = is 2 x 2(n — r) matrix, for % — 1, . . . , r, F r+1; 



, for 
is 
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2(n — r) x 2 matrix, for j — 1, . . . , r, -F r+l r+1 = is 2{n — r) x 2(n — r) matrix. 
We recall that 

G F = {geG | K(g)F = F} 

= {geG | 5 V = F} = {9eG | g F = Fg}. 

We deduce from gF = Fg that g E Gp if and only iff the following 3 conditions 
hold: 

(2.4) 
(2.5) 
(2.6) 

Because i 7 ^ 
we have 
(2.7) 

(2.8) 



-A, 
A, 



9r+l,jFjj = 0, Vj = 1, 



Fugi,r+i = 0,Vj = 1, . . . ,r, 
dijFjj FuQiji Vi, J 1, . . . , r. 

for all i = 1, . . . , r are invertible then from |2~4| and 



0,Vj 



S^+i = 0, Vz = 1, 



r. 



We now resolve the equation Let us denote 



Then 



m 

Fugij A 



b{j 

Cij d%j 



b%j @>ij 
dij Cij 

~Ca di' 



From the condition 
we deduce that 



QijFjj Fugij 



Xibij 







Xjb^ 


~t~ XiCij 





AjOjj 


Xjdij 





Xj dij 


Xidij 





= b ij - 




= 0, 



what is equivalent that 



because of the assumption, Aj ^ Xj] Aj, A-, > 0, i.e. 
(2.9) gij = 0, Vz, j = 1, . . . , r, i ^ j. 
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From p77| - ^9| we conclude that the element g, as matrix should be of the diagonal 
form 

g = diag(gu, g 22 , • • • , SW, fiV+i,r+i), 

where g„ is a 2 x 2 matrix, for alH = 1, . . . , r, g r+ i <r+ i is a 2{n — r) x 2(n — r) 
matrix. 
Denote 



9n 



we have 



-Xi 
A,; 



6i -dj 
Oi 6,; 



Our condition means that 

what is equivalent to the conditions 
(2.10) 

Let us denote 

Ji 

then the matrix of the symplectic form is 





—di 


= A, 




-di 




-Ci 




_ di 


h 



a, 



-a. 



-1 

1 



/ 



J T) 



-1 

1 



V o 

We have therefore 

gJng 1 = 

and the condition 



-1 

1 



\J n—r\ ) 



f[Jl] 
\ 



[Jl 



\ 



[Jn-r]/ 



/[guJigli] 



[grrJig. 



\ 



[gr+l,r+lJn-rg r +i r+l]/ 



9<Jn9 
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guaranting that g G Sp 2n (R) is equivalent to the conditions 

QuJiQu = Ji,Vi = l,...,n, 

9r+l,r+lJn—r9r+l,r+l Jn—r 

It means also that g u G Sp 2 (M), Vz = 1, . . . ,r and g r+ i jr+ i G Sp 2 ( n _ r )( 
i — 1, . . . , r, because <fe 6 Sp 2 (R) = SL 2 (R) means that 



From 2.10 and □ we have 



at + c 2 i = 1, 



i.e. gu G S 1 , for i = 1, . . . , r. We conclude therefore that 

/foul o 

g G iff and only if g = 



\ 



Vjr 



[<7r+l,r+l]/ 



where g u G S 1 , i = 1, . . . , r and sv+i, r+ i G Sp 2(n _ 2) ( 



For 



□ 



Corollary 2.4. If the functional F G g* w presented by a matrix of type 



( 



-Ai 
Ai 



-A r 

\ r 







V 



/ 



where all = 1, . . . , n are pairwise different, then its stabilizer is 

2(n-r)( 



g f ^ (s l y x s P2( 



and the corresponding Lie algebra is 

q f = (Lie S 1 ) x (Lie S 1 ) x . . . x (Lie S 1 ) x sp 2(n _ r) 



xsp 2(n _ r) (M). 
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3. Construction of Degenerate Principal Series Representations 

We give in this section a geometric realization of degenerate principal series rep- 
resentations by multidimensional quantization procedure and the modified versions. 
We use the root theory to construct polarization associated to the orbits. 

Let us recall from [J2p-[]3]] an important notion of polarization. 

Definition 3.1. A triple (p, p, a ) is a (a, F)-polarization iff: 

1. p is a complex Lie subalgebra of g c := q <g) K C, containing (qf)c- 

2. The subalgebra p is invariant with respect to all the operators Ad 0c x, x E G F . 

3. The vector space p + p is the complexification of the real Lie subalgebra m = 

(P + p) n 

4. All the subgroups M , H , M, H are closed in G, where M (resp. H ) is the 
connected subgroup of G, corresponding to the Lie algebra m (resp. f) = pflg) 
and M := Gp K M , H := G F x H . 

5. (T is an irreducible representation of the group H in a Hilbert space V such 
that: (i) the restriction cr\ GFnHo is a multiple of the restriction to Gp H H of 

oxf and (ii) the point er is fixed under the action of group Gf in the dual H 
of the group H . 

6. p is a representation of the complex algebra p in V, which satisfies all the 
Nelson's conditions for H , and p|t, = Da . 

Remark 3.2. For the group G = Sp 2n (lR) and the functional F of special type as in 
the previous section, the stabilizer Qp contains a Cartan subalgebra. It is therefore 
naturally to choose the polarizing complex subalgebras between parabolic ones. 
Let us denote by A the split torus of that cartan subgroup. It is easy to see that the 
centralizer 2(A) is reductive and is coincided with the stabilizer of the functional 
F. Denote 2(A) = MA the Cartan-Levi-Maltsev decomposition into the product 
of Abelian and semi-simple parts, where A = S 1 x • ■ ■ x S 1 and M = Sp 2 ( n _ r )(M.). 

Lemma 3.3. The two-fold covering of the stabilizer Gp = MA is G F ^ = S 1 x 

•■■x§ 1 xMp 2(n _ r) (M) 

Theorem 3.4. Let P = MAN be Langlands decomposition of a parabolic sub- 
group P with Lie algebra p = Lie P, pc its complexification, a G Mdi SC a discrete 
series irreducible representation of M = Sp 2(n _ r ) (R) and xf = exp(^p(F, .)) to 
be the character of Gp, extended by null from A. Then (p c , P, F, <txf) is a (a, F) 
polarization. The multidimensional quantization procedure gives us the degenerate 
principal series representations. 

Proof. The first assertion is just followed from the definition of (P, N) pairs, which 
are constructed from the theory of root of parabolic pairs. 
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Let us recall about the root theory for g = 5p 2n (IR) with respect to the pair 
(G, A) = (Sp 2n (R), S 1 x • • • x S 1 ) of a split torus A. Consider the complexification 
0c- If « is a functional over a subalgebra ac = C r , then the corresponding root 
space 

9 a :={Xe Qc ; [H,X] = a(H)X,VH eac}. 
If a and g Q are non-zero, then a is called a root. In that case, dim c g a = 1. Denote 
the unique H a such that a(H a ) = 2, the unique X a and X_ Q , such that 

[H a , X a \ = 2X a , 

[H a ,X- a ] = —2X- a . 

The triple (H a , X a , X_ a ) form a complex Lie subalgebra, which is isomorphic to 
the complexification of either s^QR) or 5U2. In the first case, we call the root non- 
compact and in the second - compact. One denotes the set of all roots by A(g, a) 
and calls it the root system with respect to the split torus A. Denote also the set of 
all compact (respectively, noncompact) roots by A c (g, a) (resp., A n (g, a)). Let us 
denote by 

p(A+(g,a):=- a ( res P-'P( A n(fl>a) := - ^ a 

aGA+(g,a) a£A+( ,a) 

) the half-sum of all compact (resp., noncompact) roots. 

Remark that in our case, g° = (qf)c — © 5 P2(«-r)(^-) an ^ we nave 

0c = (Qf)c © °- 

aeA(g,a) 

With each root a one associates a reflection R a in the space a* c 

R a {p) ■= p - 2- -a. 

{a, a) 

The Weyl group W(G, A) is generated by all these reflection and one can fix one of 
the fundamental domain (camera) to define the cones of positive roots A + (g, a) and 
the corresponding cones of positive compact roots A+(g, a) and noncompact roots 
A+(g,a). 
Choose 

Z^:=p(A+(0,a))-p(A c + (g,a)). 
Because in our case we can choose a charcters 5 F od the two-fold covering 
x • • • x S 1 x Mp 2(n _ r) (M) we can choose a complex parabolic subalgebra 

P:=(0f)c© 0°® E ^° 

a£A+( 8 ,o) aeA+( ,a) 

From the properties of parabolic subgroups, it is easy to check that we have a 
(cr, F) polarization. 
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Let us first explain the construction of the degenerate principal series. We recall 
some notations from D. Vogan : By R(Gf) denote the set of all the so called Gf- 
regular unitary pseudo-characters (A, F) consisting of a g^-regular functional F G 
q* f and a unitary representation A of Gf with differential 

DK=(^F + D5 F )l& . 
Remark that the last condition is equivalent to the assertion that 

A I(G F ) = mw\t 5 f xf , 

what figures in the orbit method. 

Denote by R irr (GF) the subset of R{Gp), consisting of the irreducible pseudo- 
characters. For a fixed F G Q* F , denote 

27T? 

R(G F , F) := {(A, F) G R(G F );DA = (—F + 5 F ) Id} 

and 

R irr (G F , F) := R(G F , F) n R irr (G F ). 

The Weyl group 

W(G,A):=tf G (A)/A 

acts on both R(G F ) and R irr (G F ). 

Recall Harish-Chandra construction ofn(A, F) : Consider the characters of type 

£ a (.) :=exp(a, .) 

for each a e A. Let us denote 

F := {x G Gf',x centralizers m and |£ a | = 1 , Va G A}. 

Then 

C7 F := F(C7 F ) := F x (G F )o, 
Gf n Go — (G'f)o 

and 

F(G F )o = F k (C7 F ) . 

Denote 

€m=((0F) C © a )n 

aeAn,, c 

and i^M the corresponding analytic subgroup. Let us denote n M °(F) the irre- 
ducible unitary representation of M , which is square-integrable modulo the center 
of M , and which is associated with F. This representation, following Harish- 
Chandra is characterized by the following condition. 

The restriction n G ° (F)\k m contains the ( finite dimensional ) irreducible unitary 
representation of K Mo with the dominant weight ^-F + D5 F with respect to A+ c , 
as a minimal K Mo -type 
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Now a representation 7r FM °(A,F) of FM := F x M can be constructed as 
follows 

n FM «(A,F)(y.x) := A(y) <g> n M «(F)(x), \/x G M ,y G F . 

Let P = MN be a parabolic subgroup of G with the Levi component M and the 
unipotent radical N, 

M = FM = FM , 
P = MAT = (FM ) x AT . 

Define now 

7r(A,F):=Ind^ Mo ^(7r FMo ®Id^) . 
Recall that if A is is irreducible and F is Qp-regular, the representation ir(A, A) is 
irreducible. 
Now we have 

A e R irr (G F ,F) = X% r (F)^X irr (F). 
This means that there exists a unique r = g\f £ G F , with a e Mdj SC , such that 

r| Po = mult(xF5 F ) 

and A = r5 F , 

7r(r5 F ,F) = Ind(G';Pc,P,r XF ). 

□ 

Remark 3.5. The restrictions of F to the radical r G p and unipotent radical M G p are 
equal to the split torus A, with Lie algebra a = W and therefore the reductions to 
the radical and unipotent radical of P give the same results as the above exposed 
ones. 



Lemma 3.6. The U(l)-covering of the stabilizer Gp = MA is G } 

S 1 x Mp: 



x 



x 



2(n-r)\ 



Corollary 3.7. Lifting to the Z/ (2)- and U(l)- coverings we obtain the Shale-Weil 
representations of the symplectic groups Sp 2n (M). 

Remark 3.8. Up to conjugation, the maximal parabolic subgroups are of the form 



/cosd 








-sin0\ 




/l Xl 



-yi 



o 
o 



id 













Sp. 



2(n-l) 



~Vn 
Xi 



\sin0 







cos6> / 











i / 



A GEOMETRIC REALIZATION OF DEGENERATE PRINCIPAL SERIES 



13 



and therefore the construction gives us the representation of degenerate principal 
series considered by S. T. Lee in 

Corollary 3.9. For the maximal parabolic subgroups P = (S 1 x Sp 2(n _i)(ffi)) x 
(R 2n x R) the corresponding degenerate principal series representations can be 
realized in the space of homogeneous functions of2n variables. 
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